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CLAIMS 

What is claimed is: 

1 . A computer-based method of synchronizing a realization of a media stream 
having a first representation synchronized with said realization, and at least one second 
representation, said method comprising: 

determining structure information for said first representation and said at least 
one second representation; 

determining structure association information between said first representation 
and said at least one second representation; and 

synchronizing said at least one second representation with said first 
synchronized representation and said realization using said structure association 
information. 

2. The method according to claim 1 , said step of determining structure information 
further comprising: 

analyzing said structure information of said first and said at least one second 
representation, and providing a stream of tree locators. 

3. The method according to claim 2, further comprising: 

aligning said determined structure information of said first representation and 
said at least one second representation. 

4. The method according to claim 3, wherein said realization comprises at least one 
version of content, said method further comprising: 

aligning said at least one version of content with said first representation to 
produce a web of relations between said at least one version of content and said first 
representation. 
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1 5. The method according to claim 4, wherein said aligning said at least one version 

2 of content with said first representation produces a web of relations between a 

3 structural view of said at least one version of content and said first representation. 

1 6. The method according to claim 3, further comprising: 

2 aligning an audio stream specified by said media stream with an audio structure 

3 corresponding to said audio stream. 

Q 7. The method according to claim 3, further comprising: 

J* aligning a text stream specified by said media stream with a text structure 

*3 corresponding to said text stream. 

LP 

5 8. A system for synchronizing a realization of a media stream having a first 
f2 representation synchronized with said realization, and at least one second 

3 

t=a representation, said method comprising: 

s= : 

l| a first structurer configured to determine structure information for said first 

Q representation; 

6 at least a second structurer configured to determine structure information for said 

7 at least one second representation; and 

8 a first aligner configured to align said structure information for said first 

9 representation and said at least one second representation. 

1 9. The system according to claim 8, further comprising: 

2 at least one renderer configured to render said at least one second 

3 representation, after being synchronized, in a form suitable for displaying as an 

4 overlayed subtitle. 
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10. The system according to claim 9, wherein said realization specifies a media 
stream, said system further comprising: 

a tree aligner configured to determine a tree structure for said media stream. 

1 1 . The system according to claim 1 0, further comprising: 
means for detecting speech and non-speech boundaries. 

12. The system according to claim 10, further comprising: 
means for detecting transitions and speaker changes. 

13. A machine-readable storage, having stored thereon a computer program having 
a plurality of code sections executable by a machine for causing the machine to 
perform the steps of: 

determining structure information for a first representation being synchronized to 
a corresponding media stream and at least one second representation; 

determining structure association information between said first representation 
and said at least one second representation; and 

synchronizing said at least one second representation with said first 
synchronized representation and said realization using said structure association 
information. 

14. The machine-readable storage according to claim 13, said step of determining 
structure information further comprising: 

analyzing said structure information of said first and said at least one second 
representation, and providing a stream of tree locators. 

15. The machine-readable storage according to claim 14, further comprising: 
aligning said determined structure information of said first representation and 

said at least one second representation. 
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16. The machine-readable storage according to claim 15, wherein said realization 
comprises at least one version of content, said machine-readable storage further 
comprising: 

aligning said at least one version of content with said first representation to 
produce a web of relations between said at least one version of content and said first 
representation. 

17. The machine-readable storage according to claim 15, wherein said aligning said 
at least one version of content with said first representation produces a web of relations 
between a structural view of said at least one version of content and said first 
representation. 

18. The machine-readable storage according to claim 15, further comprising: 
aligning an audio stream specified by said media stream with an audio structure 

corresponding to said audio stream. 

19. The machine-readable storage according to claim 15, further comprising: 
aligning a text stream specified by said media stream with a text structure 

corresponding to said text stream. 
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